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Abstract. This paper deals with the design and analysis of dynamical systems on directed 
graphs (digraphs) that achieve weight-balanced and doubly stochastic assignments. Weight-balanced 
and doubly stochastic digraphs are two classes of digraphs that play an essential role in a variety of co- 
ordination problems, including formation control, agreement, and distributed optimization. We refer 
to a digraph as doubly stochasticable (weight-balanceable) if it admits a doubly stochastic (weight- 
balanced) adjacency matrix. This paper studies the characterization of both classes of digraphs, and 
introduces distributed dynamical systems to compute the appropriate set of weights in each case. It 
is known that semiconnectedness is a necessary and sufficient condition for a digraph to be weight- 
balanceable. The first main contribution is a characterization of doubly-stochasticable digraphs. As 
a by-product, we unveil the connection of this class of digraphs with weight-balanceable digraphs. 
The second main contribution is the synthesis of a distributed strategy running synchronously on a 
directed communication network that allows individual agents to balance their in- and out-degrees. 
We show that a variation of our distributed procedure over the mirror graph has a much smaller 
time complexity than the currently available centralized algorithm based on the computation of the 
graph cycles. The final main contribution is the design of two cooperative strategies for finding a 
doubly stochastic weight assignment. One algorithm works under the assumption that individual 
agents are allowed to add self-loops. For the case when this assumption does not hold, we intro- 
duce an algorithm distributed over the mirror digraph which allows the agents to compute a doubly 
stochastic weight assignment if the digraph is doubly stochasticable and announce otherwise if it is 
not. Various examples illustrate the results. 

Key words. Distributed dynamical systems, set-valued stability analysis, cooperative control, 
weight-balanced digraphs, doubly stochastic digraphs 
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1. Introduction. In the last years there has been considerable interest in under- 
standing the underpinnings of collective behavior from a dynamical systems perspec- 
tive. A variety of phenomena from biology and physics have been carefully studied, 
and more are comin g int o light. A few examples of a vast literature include oscillator 
synchronization [H], 35, [36j |\ self- org anization in biological systems 0, EH Hl|, and 



animal grouping and aggregation [16l r26j ■ In the study of collective behavior, a major 
concern is the modeling of the interactions between individual agents and the under- 
standing on how local interconnections give rise to global emergent behavior. Such 
coordination problems have also become a major research area in engineering because 
of the connections with distributed robotics, networked systems, and autonomy, see 
e -g-: 0,113: HI] and references therein. 

This paper is a contribution to this buoying field. From a systems and controls 
perspective, one of the main objectives is the design of dynamical systems that are 
distributed over a given interaction topology and whose performance guarantees can 
be formally established with regards to the task at hand. In both analysis and design, 
the interaction topology (or graph) of the underlying network is a key element as 
it determines the information available to each individual. Typically, directed inter- 
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action topologies (where interactions among agents are unidirectional) pose greater 
technical challenges. 

In this paper, we study dynamical systems on two important classes of directed 
graphs, weight-balanced and doubly stochastic digraphs. A digraph is weight-balanced 
if, at each vertex, the sum of the weights of the incoming edges is equal to the sum 
of the weights of the outgoing edges. A digraph is doubly stochastic if it is weight- 
balanced and these sums at each vertex are equal to one. The notion of weight- 
balanced digraph is ke y in establishing convergence results of distributed algorithms 
for average-consensus |27l . [28| and consensus on general functions @ via Lyapunov 
stability analysis. Weight-balanced digraphs also appear in the design of leader- 
follower strategies under time delays [18(, virtual leader strategies under asymmetric 
interactions [33 [and stable flocking algorithms for agents with significant inertial 
effects [joj . In 13], a traffic-flow problem is introduced with n junction and m one- 
way streets with the goal of ensuring a smooth traffic flow. It is shown that the 
problem can be reduced to computing weights on the edges of the associated digraph 
so that it is weight-balanced. Furthermore, necessary and sufficient conditions are 
given for a digraph to be weight-balanced and a centralized algorithm is presented for 
computing the weight on each edge. Doubly stochastic digraphs also play a key role 
in networked control problems. Examples include distributed averaging [g, 28, 32, 3^] 
and distributed convex optimization |l9l . I2BI |40| . Convergence in gossip algorithms 
also relies on the structure of doubly stochastic digraphs, see (HI. l2lj|. 

Because of the numerous algorithms available in the literature that use weight- 
balanced and doubly stochastic interaction topologies, it is important to develop dis- 
tributed strategies that allow individual agents to find the appropriate weight assign- 
ments, i.e., to balance their in- and out-degrees, so that the overall interaction digraph 
is weight-balanced or doubly stochastic. In particular, we are interested in design- 
ing discrete-time dynamical systems that can be run on the directed communication 
network which, in finite time, converge to a weight-balanced/doubly stochastic as- 
signment. As a necessary step towards this goal, it is an important research question 
to characterize when a digraph can be given an edge weight assignment that makes it 
belong to either category. Our focus in this paper is on nonzero weight assignments. 
In addition to its theoretical interest, the consideration of nonzero weight assignments 
is also relevant from a practical perspective, as the use of the maximum number of 
edges leads to higher algebraic connectivity (HI, which in turn affects positively the 
rate of convergence [H, 0, 13, 21 1 of the algorithms typically executed over doubly 



stochastic digraphs. Alternative versions of the problem, where some edge weights 
are allowed to be zero, are also worth exploring, although we do not consider them 
here. From a distributed perspective, such problems pose nontrivial challenges, as 
individual agents would need a procedure to determine if severing a particular edge 
(i.e., setting its weight to zero) or set of them disconnects the overall digraph. Such 
procedures would necessarily require information beyond the immediate neighborhood 
of the agents. 

Our contributions are threefold. First, we obtain a characterization of doubly 
stochasticablc digraphs (a characterization of weight-balanceable digraphs is already 



available in the literature, cf. [17[). As a by-product of our study, we demonstrate 
that the set of doubly stochasticable digraphs can be generated by a special subset of 
weight-balanced digraphs. Second, we develop two discrete-time set-valued dynamical 
systems on the directed communication network which converge to a weight-balanced 
digraph in finite time. The imbalance-correcting algorithm is a synchronized 
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distributed strategy on a digraph in which each agent provably balances her in- and 
out-degrees in finite time. In this algorithm, each individual agent can send a message 
to one of its out- neighbors and receive a message from her in- neighbors. The mirror 
imbalance-correcting algorithm is a provably correct distributed strategy over 
the mirror digraph whose time complexity is much smaller than that of the existing 



centralized strategy of [17[ based on the computation of all cycles of the digraph. 
Third, we synthesize discrete-time dynamical systems to construct doubly stochas- 
tic adjacency matrices. The imbalance-correcting algorithm with self-loop 
addition achieves this task under the assumption that individual agents can add 
self-loops to the structure of the digraph. If this is not allowed, we introduce the 
load-pushing algorithm, which is a strategy distributed over the mirror digraph 
that allows agents to: (i) identify if their digraph is doubly stochasticable and, if 
this is the case, (ii) find a set of weights that makes the digraph doubly stochastic. 
The algorithm relies on the notion of DS-character of a strongly connected doubly 
stochasticable digraph and its design and correctness analysis draw substantially on 
distributed solutions to the maximum flow problem [l], |3l| • 

This paper is organized as follows. Section [5] presents some mathematical prelim- 
inaries. Section [3] gives the necessary and sufficient conditions for the existence of a 
doubly stochastic adjacency matrix assignment for a given digraph. Section [4] intro- 
duces two weight-balancing algorithms that allow each agent to balance her in- and 
out-degrees. We characterize their distributed character as well as the convergence 
and complexity properties. In Section [31 we discuss the problem of designing cooper- 
ative strategies that allow agents to find a doubly stochastic edge weight assignment. 
Finally, Section |6j contains our conclusions and ideas for future work. 

2. Mathematical preliminaries. We adopt some basic notions from pi. 1(1 [Io| . 

A directed graph, or simply digraph, is a pair G = (V,E), where V is a finite set 
called the vertex set and E C V x V is the edge set. If \V\ — n, i.e., the cardinality 
of V is n G Z>o, we say that G is of order n which, unless otherwise noted, is 
the standard assumption throughout the paper. We say that an edge (it, v) G E is 
incident away from u (or an out-edge of u) and incident toward v (or an in-edge of 
v), and we call u an in-neighbor of v and v an out-neighbor of u. We denote the set of 
in- neighbors and out- neighbors of v, respectively, with J\f ln (v) and Af° nt (v). The in- 
degree and out-degree of v, denoted di n (v) and d ont (v), are the number of in- neighbors 
and out-neighbors of v, respectively. We call a vertex v isolated if it has zero in- and 
out-degrees. An undirected graph, or simply graph, is a pair G = (V,E), where V 
is a finite set called the vertex set and the edge set E consists of unordered pairs of 
vertices. In a graph, neighboring relationships are always bidirectional, and hence we 
simply use neighbor, degree, etc. for the notions introduced above. A graph is regular 
if each vertex has the same number of neighbors. The union G\ U G 2 of digraphs 
Gt = {Vi,E x ) and G 2 = {V 2 ,E 2 ) is defined by GiUG 2 = (Vi U V 2 ,E 1 U E 2 ). The 
intersection of two digraphs can be defined similarly. A digraph G is generated by a 
set of digraphs G\, . . . , G m if G = G\ U ■ • • U G m . We let E~ C V x V denote the set 
obtained by changing the order of the elements of E, i.e., (v,u) G E~ iff (u,v) 6 E. 
The digraph G = (V, E U E~) is the mirror of G. 

A weighted digraph is a triplet G = (V,E,A), where (V,E) is a digraph and 
A G R"q™ is the adjacency matrix. We denote the entries of A by a^-, where i,j G 
{1, . . . ,n}. The adjacency matrix has the property that the entry a^- > if (vi, Vj) G 
E and = 0, otherwise. If a matrix A satisfies this property, we say that A can 
be assigned to the digraph G = (V,E). Note that any digraph can be trivially seen 
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as a weighted digraph by assigning weight 1 to each one of its edges. We will find it 
useful to extend the definition of union of digraphs to weighted digraphs. The union 
G\ U G 2 of weighted digraphs G\ = {V\,Ex,A\) and G 2 = (V 2 ,E 2 ,A 2 ) is defined by 
Gi U G 2 = (Vi U V 2 ,Ei U E 2 ,A), where 

^Vinv 2 = ^i|viny 2 + A 2 \ Vl nv 2 , ^lvi\v 2 = Ai, ^lva\Vi = A 2 . 

For a weighted digraph, the weighted out-degree, weighted in-degree and imbalance 
of Vi, i S {1, . . . , n}, are respectively, 

n n 
d out fa ) = ^ a V ' d Tn Oi ) = 53 a Ji ' W ( U i ) = d Tn ( V i ) ~ d out K ) • 

It is worth noticing that the imbalances across the graph always satisfy 

n 

5>(O = 0. (2.1) 

t=l 

2.1. Graph connectivity notions. A directed path in a digraph, or in short 
path, is an ordered sequence of vertices so that any two consecutive vertices in the 
sequence are an edge of the digraph. A cycle in a digraph is a directed path that starts 
and ends at the same vertex and has no other repeated vertex. Hence, a self-loop is a 
cycle while an isolated vertex is not. Two cycles are disjoint if they do not have any 
vertex in common. We denote by G cyc a union of some disjoint cycles of G (note that 
G cyc can be just one cycle). A semi-cycle of a digraph is a cycle of its mirror graph. 
Note that a semi-cycle is a directed path in the mirror digraph. A digraph is called 
acyclic if it contains no cycles. A directed tree is an acyclic digraph which contains 
a vertex called the root such that any other vertex of the digraph can be reached by 
one and only one directed path starting at the root. A breadth-first spanning tree 
BFS(G, v) of a digraph G — {V,E) rooted at v S V is a directed tree rooted at v that 
contains a shortest path from v to every other vertex of G, see @, |37} • 

A digraph is strongly connected if there is a path between each pair of distinct 
vertices and is strongly semiconnected if the existence of a path from v to w implies 
the existence of a path from w to v, for all v, w G V. Clearly, strong connectedness 
implies strong semiconnectedness, but the converse is not true. The strongly connected 
components of a directed graph G are its maximal strongly connected subdigraphs. 

2.2. Basic notions from linear algebra. A matrix A £ R"q™ is weight- 
balanced if Y^j=i a ij = Y^j=i a jii f° r au * ^ {l,...,n}. A matrix A G M™Q n is 
row- stochastic if each of its rows sums 1. One can similarly define a column-stochastic 
matrix. We denote the set of all row-stochastic matrices on M™g" by RStoc(R™Q ra ). 
A non-zero matrix A £ R"q™ is doubly stochastic if it is both row-stochastic and 
column-stochastic. A matrix A £ {0, l} nx ™ is a permutation matrix, where n £ Z>i, 
if A has exactly one entry 1 in each row and each column. A matrix A £ M™^" is 
irreducible if, for any nontrivial partition JUK of the index set {1, . . . , n}, there exist 
j £ J and k £ K such that ajk ^ 0. We denote by Irr(R™p") the set all irreducible 
matrices on R"q™. Note that a weighted digraph G is strongly connected if and only 
if its adjacency matrix is irreducible |2j. 

One can extend the adjacency matrix associated to a disjoint union of cycles G cyc 
of G to a matrix A cyc £ R™ xn by adding zero rows and columns for the vertices of G 
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that are not included in G cyc . Note that the matrix A cyc is the adjacency matrix for 
a subdigraph of G. We call A cyc the extended adjacency matrix associated to G cyc . 
The following result establishes the relationship between cycles of G and permutation 
matrices. 

Lemma 2.1 (Cycles and permutation matrices). The extended adjacency matrix 
associated to a union of disjoint cycles G cyc is a permutation matrix if and only if 
G cyc contains all the vertices of G. 

Proof. It is clear that if G cyc is a union of some disjoint cycles and contains all the 
vertices of G, then the adjacency matrix associated to G cyc is a permutation matrix. 
Conversely, suppose that G cyc does not contain one of the vertices of G. Then the 
adjacency matrix associated to G cyc has a zero row and thus is not a permutation 
matrix. □ 

2.3. Weight-balanced and doubly stochastic digraphs. A weighted di- 
graph G is weight-balanced (resp. doubly stochastic) if its adjacency matrix is weight- 
balanced (resp. doubly stochastic). Note that G is weight-balanced if and only if 
dout( v ) = dj^iv), for all v G V. A digraph is called weight-balanceable (resp. dou- 
bly stochasticable) if it admits a weight-balanced (resp. doubly stochastic) adjacency 
matrix. The following two results characterize when a digraph is weight-balanceable. 

Theorem 2.2 ([17|). A digraph G — (V,E) is weight-balanceable if and only if 
the edge set E can be decomposed into k subsets E\ , . . . , E& such that 

(i) E = Ei U E 2 U . . . U E k and 

(ii) each G = (V, Ej), i = {1, . . . , k}, is weight-balanceable. 

Theorem 2.3 ([12]). Let G = (V,E) be a digraph. The following statements are 
equivalent: 

(i) G is weight-balanceable, 

(ii) Every element of E lies in a cycle, 
(Hi) G is strongly semiconnected. 

The proofs of these theorems are constructive but rely on the computation of all 
the cycles of the digraph. The basic idea is that if one can find all the cycles for a 
given strongly semiconnected digraph, then, by taking the weighted union of these 
cycles (i.e., by assigning to each edge the number of times it appears in the cycles), 
one arrives at a weight-balanced assignment, see [l7j |. 

Note that Theorem 12.31 implies that any strongly semiconnected digraph can be 
generated by the cycles contained in it. Therefore, it makes sense to define a minimal 
set of cycles with this property. This motivates the introduction of the following 
concept. 

Definition 2.4 (Principal cycle set). Let G be a strongly semiconnected digraph. 
LetC(G) denote the set of all subdigraphs of G that are either isolated vertices, cycles 
of G, or a union of disjoint cycles of G. PC C(G) is a principal cycle set of G if its 
elements generate G, and there is no subset of C(G) with strictly smaller cardinality 
that satisfies this property. 

Note that there might exist more than one principal cycle set. However, by 
definition, the cardinalities of all principal cycle sets are the same. We denote this 
cardinality by p(G). Note that a cycle, or a union of disjoint cycles, that contains 
all the vertices has the maximum number of edges that an element of C(G) can have. 
Thus these elements are the obvious candidates for constructing a principal cycle set. 
Principal cycle sets give rise to weight-balanced assignments, as we state next. 

Lemma 2.5 (Weight-balancing via principal cycle sets). Let G be a strongly 
semiconnected digraph. Then, the union of the elements of a principal cycle set P 
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of G, considered as subdigraphs with trivial weight assignment, gives a set of positive 
integer weights which make the digraph weight-balanced. 

Proof. Since each element of a principal cycle P is cither an isolated vertex, a 
cycle, or union of disjoint cycles, it is weight-balanced. By definition, G can be written 
as the union of the elements of P. Thus by Theorem 12. 2[ the weighted union of the 
elements of P gives a set of weights makes the digraph G weight-balanced. □ 

In general, the assignment in Lemma 12.51 uses fewer number of cycles than the 
ones used in Theorem 12.31 

2.4. Discrete set- valued analysis. Here, we provide a brief exposition of use- 
ful concepts from discrete-time set-valued dynamical systems following 0, [22| ■ For 
A C M", let F : A =4 A denote a set-valued map that takes a point in X to a subset 
F(x) of X. F is non-empty if F(x) ^ 0, for all x G X. A point x* G X is a fixed point 
of F if x* G F(x*). An evolution of F on X is any trajectory 7 : Z>o — > A such that 

7(fc + l) G F(7(fc)), for all fc G Z> . 

The map F is closed at a; G A if, for any two convergent sequences {xk}kL and 
witn um fe^oo a^fe = af, lim*-**, Vk = V, and y k G F(xfc), for all k G Z> , we 
have y G F(x). The map F is closed on A if it is closed at x, for all x G A. A 
set W C I is weakly positively invariant with respect to F if for any x G W there 
exists y € W such that y G F(x). W is strongly positively invariant with respect to 
F if F(x) C VK, for all x G W. Finally, a continuous function V : A — > K is called 
non-increasing along F in W C A if V^(y) < V(x), for all x G W and y G F(x). 
Equipped with these tools, one can formulate the following set-valued version of the 
LaSalle invariance principle, which will be most useful in the developments later. 

Theorem 2.6 (LaSalle invariance principle for discrete-time set-valued dynamical 
systems). Let F : X =4 A be a set-valued map on X C K n and let W C A be a closed 
and strongly positively invariant with respect to F. Suppose F is non-empty and closed 
on W and all evolutions of F with initial condition in W are bounded. Let V : A — > R 
be continuous and non-increasing function along F on W . Then, any evolution of F 
with initial condition in W approaches a set of the form 5ny _1 (c), where c G K and 
S is the largest weakly positively invariant set contained in {x G W \ there exists y G 
F(x) such that V(x) = V(y)}. 

3. When does a digraph admit a doubly stochastic weight assignment?. 

Our main goal in this section is to obtain necessary and sufficient conditions that char- 
acterize when a digraph is doubly stochasticable. This characterization is a necessary 
step before addressing in later sections the design of distributed dynamical systems 
that find doubly stochastic weight assignments. As an intermediate step of this charac- 
terization, we will also find it useful to study the relationship between weight-balanced 
and doubly stochastic digraphs. 

Note that strong semiconnectedness is a necessary, and sufficient, condition for a 
digraph to be weight-balanceable. All doubly stochastic digraphs are weight-balanced; 
thus a necessary condition for a digraph to be doubly stochasticable is strong semi- 
connectedness. Moreover, weight-balanceable digraphs that are doubly stochasticable 
do not have any isolated vertex. However, none of these conditions is sufficient. A 
simple example illustrates this. Consider the digraph shown in Figure l3~Tl Note that 
this digraph is strongly connected; thus there exists a set of positive weights which 
makes the digraph weight-balanced. However, there exists no set of nonzero weights 
that makes this digraph doubly stochastic. Suppose 
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Fig. 3.1. A weight-balanceable digraph for which their exists no doubly stochastic adjacency 
assignment. 
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where on € K>o, for all i € {1, . . . , 5}, is a doubly stochastic adjacency assignment for 
this digraph. Then a simple computation shows that the only solution that makes the 
digraph doubly stochastic is by choosing 013 = 0, which is not possible by assumption. 
Thus this digraph is not doubly stochasticable. 

The following result will simplify our analysis by allowing us to restrict our at- 
tention to strongly connected digraphs. 

Lemma 3.1 (Strongly connected components of a doubly stochasticable digraph). 
A strongly semiconnected digraph is doubly stochasticable if and only if all of its 
strongly connected components are doubly stochasticable. 

Proof. Let Gi and G2 be two strongly connected components of the digraph. 
Note that there can be no edges from v\ G G\ to v-i <E G2 (or vice versa). If this were 
the case, then the strong semiconnectedness of the digraph would imply that there is 
a path from v-i to vi in the digraph, and hence Gi U Gi would be strongly connected, 
contradicting the fact that G\ and G2 are maximal. Therefore, the adjacency matrix of 
the digraph is a block-diagonal matrix, where each block corresponds to the adjacency 
matrix of a strongly connected component, and the result follows. □ 

As a result of Lemma l3.1[ we are interested in characterizing the class of strongly 
connected digraphs which are doubly stochasticable. 

3.1. The relationship between weight-balanced and doubly stochastic 
adjacency matrices. As an intermediate step of the characterization of doubly 
stochasticable digraphs, we will find it useful to study the relationship between weight- 
balanced and doubly stochastic digraphs. The example in Figure 13.11 underscores 
the importance of characterizing the set of weight-balanceable digraphs that are also 
doubly-stochasticable. 

We start by introducing the row- stochastic normalization map <f> : Irr(M"Q n ) — > 
RStoc(R^") defined by 

(f>: (oy) H- ( ) . 

Note that, for A e Irr(R"g"), cj)(A) is doubly stochastic if and only if 

n 

E Q ij _ 1 

l= l £l=l HI 
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for all j S {1, . . . , n}. The following result characterizes when the digraph associated 
with an irreducible weight-balanced adjacency matrix is doubly stochasticable. 

Theorem 3.2 (Weight-balanced and doubly stochasticable digraphs). Let A £ 
Irr(K"Q™) be an adjacency matrix associated to a strongly connected weight-balanced 
digraph. Then 4>(A) is doubly stochastic if and only if Ym=i a u ~ @> f or a ^ * ^ 
{1, . . . , n}, for some C £ K>o- 

Proof. The implication from right to left is immediate. Suppose then that A is 
associated to a strongly connected weight-balanced digraph. Then we need to show 
that if A satisfies the following set of equations 

n n n 



i=i i=i 



En 
1=1 a U 



for all j £ {1, ...,n}, there exists C £ R>o such that Yli=i a u = C, for all i £ 
{1, . . . , n}. Let Cfc = y^iLi Ofci, k £ {1, . . . , n}. Then the doubly stochastic conditions 
can be written as 

^ + ^ + ••• + ^ = 1, (3-1) 

for all j £ {1, . . . , n}. Note that ^ 0, for all k € {1, . . . , «}, since A is irreducible. 
By the weight-balanced assumption, we have 

o-i j + a2j + ■ • ■ + a n j = Cj, 

for all j £{!,.. .,n}. Thus 



From (lO and (|3~2|) . we have 



r, rj " ! -{c h c 3 



(3.2) 



0, (3.3) 



for all j £ {1, . . . , n}. Suppose that, up to rearranging, 

Ci = min{C fc | k £ {l,...,n}}, 

k 

and, < Ci < d, for all i 6 {2, ... , ra}. Then fl53) gives 

° 21 (^-^) + -" + fl " 1 (ci-^) =0; 

thus aji = 0, for all j G {2, . . . , n}, which contradicts the irreducibility assumption. 
If the set {Cfe}^ =1 has more than one element giving the minimum, the proof follows 
a similar argument. Suppose 

Ci = C 2 = min{C fc | k £ {1, . . . , n}}, 



and suppose that < C\ — C2 < Ci, for all i £ {3, . . . , n}. Then we have 
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and 

and thus aji = = a,j2, for all j G {3, . . . , n}, which contradicts the irreducibility 
assumption. The same argument holds for an arbitrary number of minima. □ 

Corollary 3.3 (Self-loop addition makes a digraph doubly stochasticable) . Any 
strongly connected digraph is doubly stochasticable after adding enough number of self- 
loops. 

Proof. Any strongly connected digraph is weight-balanceable. The result fol- 
lows from noting that, for any weight-balanced matrix, it is enough to add self- loops 
with appropriate weights to the vertices of the digraph to make the conditions of 
Theorem O hold. □ 

Regular undirected graphs trivially satisfy the conditions of Theorem 13.21 and 
hence the following result. 

Corollary 3.4 (Undirected regular graphs). All undirected regular graphs are 
doubly stochasticable. 

We capture the essence of Theorem 13.21 with the following definition. 

Definition 3.5 (C-regularity) . Let G — {V,E) be a strongly connected digraph 
and let A be a weight-balanced adjacency matrix which satisfies the conditions of The- 
orem [37B with C G R>o- Then we refer to G = (V, E, A) as a G-regular digraph. 

3.2. Necessary and sufficient conditions for doubly stochasticability. In 

this section, we provide a characterization of the structure of digraphs that are doubly 
stochasticable. We start by giving a sufficient condition for doubly stochasticability. 

Proposition 3.6 (Sufficient condition for doubly stochasticability). A strongly 
connected digraph G is doubly stochasticable if there exists a set {G* yc }| =1 C C(G), 
where £ > p{G), that generates G and such that, for each i G {1, . . . , £}, G cyc contains 
all the vertices of G. 

Proof. Suppose G — LT? =1 G* yc , where G l cyc G C(G) contain all the vertices, for all 
i G {!.,...,£}. Consider the adjacency matrix 

? 

i=l 

where A]. yc is the extended adjacency matrix associated to G* yc . Note that A is 
weight-balanced and satisfies the condition of Theorem 13.21 (the sum of each row is 
equal to £). Thus G is doubly stochasticable. □ 

Proposition 13.61 suggests the definition of the following notion. Given a strongly 
connected digraph G that satisfies the sufficient condition of Proposition l3"l)I DS(G) C 
C(G) is a DS-cycle set of G if all its elements contain all the vertices of G, they generate 
G, and there is no subset of C(G) with strictly smaller cardinality that satisfies these 
properties. The cardinality of any DS-cycle set of G is the DS-character of G, denoted 
ds(G). By definition, ds(G) > p(G), where recall that p(G) denotes the cardinality of 
any principal cycle set. 

The following result states that the condition of Proposition 13.61 is actually nec- 
essary for a digraph to be doubly stochasticable. 

Proposition 3.7 (Necessary condition for doubly stochasticability). Let G be a 
strongly connected digraph. Suppose that one can assign a doubly stochastic adjacency 
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matrix A to G. Then G satisfies the condition of Provosition [Xol and 

t 

A = XiA l cyc , 
»=i 

where 

• {Ajti c R >0 , Eti K = 1, arid £ > ds(G). 

• ^4 cyc , i £ {1, • • • , £}, * s ^ e extended adjacency matrix associated to an element 
of C(G) that contains all the vertices. 

Proof. Let A be a doubly stochastic matrix associated to G. By the Birkhoff-von 
Neumann theorem Q , a square matrix is doubly stochastic if and only if it is a convex 
combination of permutation matrices. Therefore, 



^ — ^ ^ ^i-^permi 



where A-j € K> , J2i=i ^» = 1j an d ^perm ^ s a permutation matrix for each i G 
{1, . . . , nl}. By Lemma HOI for all A, > 0, one can associate to the corresponding 
A l peini a union of disjoint cycles that contains all the vertices. Thus each A l porm is 
an extended adjacency matrix associated to an element of C(G) that contains all the 
vertices. This proves that there exists a set {G* yc }f =1 C C(G), where £ > p(G), that 
generates G; thus G satisfies the condition of Proposition 13.61 Let us rename all the 
nonzero coefficients A; > to A^. In order to complete the proof, we need to show 
that at least ds(G) of the Ai's are nonzero. Suppose otherwise. Since each ^4p erm with 
nonzero coefficient is associated to an element of C(G), this means that the digraph G 
can be generated by fewer elements than ds(G), which would contradict the definition 
of DS-character. □ 



Note that Propositions 13.61 and 13.71 fully characterize the set of doubly stochas- 
ticable strongly connected digraphs. We gather this result in the following corollary. 

COROLLARY 3.8 (Necessary and sufficient condition for doubly stochasticability) . 
A strongly connected digraph G is doubly stochasticable if and only if there exists a set 
{G l cyc }^ =1 C C(G), where £ > ds(G), that generates G and such that G* yc contains 
all the vertices of G, for each i S {1, ...,£}. 

If a doubly stochasticable digraph is not strongly connected, one can use these 
results for Corollary 13.81 on each strongly connected component. 

Example 3.9 (Weight-balanceable, not doubly stochasticable digraph). Con- 
sider the digraph G shown in Figure l3~2t a). It is shown in [ll| that there exists a set 
of weights which makes this digraph weight-balanced. We show that the digraph is 
not doubly stochasticable. Suppose there exists a union of disjoint cycles containing 
all the vertices. Since the edge (v2,Va) only appears in the cycle G cyc = {vi,V2,vs}, 
one element in such a union must contain this cycle. But then it is impossible for this 
element to also contain and U5, as every cycle containing V4 and ^5 also contains 
at least one of the vertices {vi,V2,vs}. Thus by Corollary 13.81 there exists no doubly 
stochastic adjacency assignment for this digraph. One can verify this by trying to 
find such assignment explicitly, i.e., by seeking on £ K>0: where i £ {1, . . . , 8}, such 
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Fig. 3.2. The digraph of Examvles \3.9\ and l3~W[ are shown in plots (a) and (b), respectively. 





Fig. 3.3. The only principal cycle set for the digraph of Examvle \3. 10\ contains the above cycles. 
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is doubly stochastic. A simple computation shows that such an assignment is not 
possible unless 012 = as = «6 — 0, which is a contradiction. • 
Example 3.10 (Doubly stochasticable digraph). Consider the digraph G shown 
in Figure ItOT b'). One can observe that the only principal cycle set of G contains the 
two cycles shown in Figure 13.31 Both of these cycles pass through all the vertices of 
the digraph and thus, using Corollary 13.81 this digraph is doubly stochasticable. Note 
that this digraph has another three cycles, shown in Figure 13.41 none of which is in 
the principal cycle set. The adjacency matrix assignment 



.4 



/ 2 \ 

2 

1 1 

1 1 
\ 1 1 J 



obtained by the sum of the elements of the principal cycle set, is weight-balanced 
and satisfies the conditions of Theorem 13.21 and thus is doubly stochasticable. Also 
note that not all the weight-balanced adjacency assignments become doubly stochastic 
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Fig. 3.4. Cycles of the digraph G of Examvle \3. 1(H which are not in the principal cycle set. 



under the row-stochastic normalization map. An example is given by 



A = 



( 3 \ 

3 

2 1 

2 2 

\ 1 2 / 



An alternative question to the one considered above would be to find a set of 
edge weights (some possibly zero) that make the digraph doubly stochastic. Such 
assignments exist for the digraph in Figure [3~T1 However, such weight assignments are 
not guaranteed, in general, to preserve the connectivity of the digraph. The following 
result gives a sufficient condition for the existence of such a weight assignment. 

Proposition 3.11 (Doubly stochasticable digraphs via weight assignments with 
some zero entries). A strongly connected digraph G admits an edge weight assignment 
(where some entries might be zero) such that the resulting weighted digraph is strongly 
connected and doubly stochastic if there exists a cycle containing all the vertices ofG. 

It is an interesting research question to determine sufficient and necessary condi- 
tions that characterize digraphs that are doubly stochasticable via weight assignments 
that can have some zero entries and still preserve the graph connectivity. Regard- 
ing Proposition 13 . 1 fl note that even if connectivity is preserved, fewer edges lead to 
smaller algebraic connectivity (38|, which in turn affects negatively the rate of con- 
vergence of the consensus, optimization, and gossip algorithms executed over doubly 
stochastic digraphs, see e.g., d,H, [HI 21 j. 

3.3. Properties of the topological character of doubly stochasticable 
digraphs. In this section, we investigate the properties of DS-cycle sets and of their 
cardinality ds(G). First, we show that rational weight assignments are sufficient to 
make an adjacency matrix doubly stochastic. 

Lemma 3.12 (Rational weight assignments). Assume there exists a real weight 
assignment that makes a digraph G doubly stochastic. Then, there also exists a ratio- 
nal weight assignment that makes G doubly stochastic. 

Proof. By assumption, G is doubly stochasticable. Thus, by Corollary 13.81 it 
has a DS-cycle set. Using elements of this DS-cycle set, one can construct an integer 
weight assignment yl w b that makes G weight balanced and satisfies the conditions of 
Theorem 13.21 with some C £ Z>o- Therefore, ^A w b gives rise to a rational weight 
assignment that makes G doubly stochastic. □ 
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Lemma 13.121 allows us to focus the attention, without loss of generality, on dou- 
bly stochastic adjacency matrices with rational entries or, alternatively, on weight- 
balanced adjacency matrices with integer entries whose rows and columns all sum up 
to the same integer. This is what we do in the rest of the paper. 

Proposition 3.13 (Properties of the DS-character) . Let G be a strongly con- 
nected doubly stochasticable digraph of order n G Z>o with DS-character ds(G). Then 
for C > ds(G) ; there exists a weight assignment A w b G Z"g n that makes G a C- 
regular digraph. 

Proof. By Corollary 13.81 it is clear that one can generate A w b G Z™g™ that 
makes G weight-balanced and also satisfies the conditions of Theorem 13.21 for C = 
ds(G), just by taking the weighted union of the members of a DS-cycle set. Let 
C > ds(G). Choose a set of integer numbers A.; G Z >0 , for i G {1, . . . , ds(G)}, such 
that X)i=i G ' ^» — C- Consider the adjacency matrix 

ds(G) 
A = \iA l cyc , 
i=l 

where A l cyc is the extended adjacency matrix associated to the ith element of the 
DS-cycle set. The matrix A is weight-balanced adjacency and satisfies the conditions 
of Theorem [321 □ 

We finish this section by bounding the DS-character of a digraph. 

Lemma 3.14 (Bounds for the DS-character). Let G = (V, E) be a doubly stochas- 
ticable strongly connected digraph. Then 

max{maxc? out (w), maxc?i n (w)} < ds(G) < \E\ — \V\ + 1. 

Proof. The first inequality follows from the fact that none of the out-edges of 
the vertex v (similarly, none of of in-edges of this vertex) are contained in the same 
element of any DS-cycle set DS(G). To show the second inequality, take any element 
of DS(G). This element must contain |V| edges. The rest of the edges of the digraph 
can be represented by at most \E\ — \V\ elements of C(G), and hence the bound follows. 
□ 

4. Strategies for making a digraph weight-balanced. The existing central- 
ized algorithm for constructing a weight-balanced digraph, proposed in fl7| , relies on 
computing all the cycles of the digraph and thus it is computationally complex. In this 
section, we instead introduce two distributed strategies that are guaranteed to find 
a weight-balanced adjacency matrix for a weight-balanceablc digraph and compare 
their convergence properties. Given the characterization of Theorem 12. 3[ we focus 
on strongly semiconnected digraphs. Since each strongly connected component of the 
digraph is completely independent from the others and can be balanced separately, 
without loss of generality we deal with strongly connected digraphs throughout the 
section. 

4.1. The imbalance-correcting algorithm. Given a strongly connected di- 
graph G, we introduce an algorithm, distributed over G, which allows the agents 
to balance their in- and out-degrees. We start by an informal description of the 
imbalance-correcting algorithm: 

(i) each agent can send messages to her out-neighbors and receive messages from 
her in- neighbors. There is an initial round when each agent assigns a weight 
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to each out-edge and sends it to her corresponding out-neighbor. In this way, 
everybody can compute her in-degree. After this, at most, only one out-edge 
per agent is changed in each round; 

(ii) for each agent, if the in-degree is more than the out-degree, the agent changes 
the weight on one of the out-edges with the minimum weight such that she is 
balanced and sends a message to the corresponding out-neighbor informing 
her of the change; 

(iii) after receiving the messages, each agent updates the in- and out- degrees in 
the next round and repeats the above process. 

Note that this algorithm updates the weights synchronously. In the following, 
we give a formal description. Suppose that a communication network is given by 
a strongly connected digraph G = (V,E). Let Adj(G) C R>g™ be the subset of all 
possible adjacency matrices with nonnegative entries associated to G. For A £ Adj(G) 
and i £ {1, . . . , n}, let 

a* = min {a lk \ a lk ^ 0}, 

ke{l,...,n}\{i} 

J* = {j£{l,...,n}\{i}|ay=a*}- 

The set- valued evolution map /i mc0 r : Adj(G) =4 Adj(G) assigns to A = (a^) £ 
Adj(G) the set 

/imcor (A) = {B £ Adj(G) | for each i £ {1, . . . , n}, there exists j* £ J* with 

b = ( ctij + u(vi) if cj(Ui) > and j = j* 1 
1J 1 dij, otherwise J ' ^ ' ' 

Note that the discrete-time dynamical system on Adj(G) defined by the map 
/imcor corresponds to the imbalance-correcting algorithm presented above. Our 
strategy to establish the correctness of the algorithm is then based on characterizing 
the properties of the set-valued map /i mc0 r and then applying the LaSalle invariance 
principle, cf. Theorem 12.61 We first establish that the map is closed. 

Lemma 4.1 (Closedness of /imcor)- The map /imcor is closed on Adj(G). 

Proof. Let D £ Adj(G) and consider two sequences {D k } k x L 1 C Adj(G) and 
{G/cj^Lx C Adj(G) such that G fc £ /imcor^fc), for all fc £ Z >0 , lim^oo D k — D and 
lim/j^oo Gfc = G. Since J*(D k ) C {1, .. .,n} and n is finite, there must exist a set 
J\ X • • • X J n in {1, . . . , n} n that appears infinitely often in the sequence { J-j* (D k ) x • • • x 
J* l {Dk)} k % 1 - Therefore, there exists a subsequence of {D k } k ^L 1 which, with a slight 
abuse of notation and for simplicity, we denote in the same way, such that J*{D k ) = 
Ji, for all k £ Z>i. Now, because C k £ /imcor(-Dfc)> there exist (ji(fc), . . . , j n (k)) £ 
Jl x . . . x J n for each k £ Z>o such that one can write 

^ Ck y = \( D k)ij+^k(vi) if u k {vi) > 0, and j = j l {k) 1 
11 \(Dk)ij, otherwise, 

where (D k )ij and (C k )ij denote, respectively, the entries of D k and C k , and uj k {vi) is 
the imbalance of vertex Vi in the weight assignment D k . Reasoning as before, since 
Jl x . . . X J n is finite, there exists an element (ji, . . . , j n ) of this set that appears 
infinitely often in the sequence {(ji(fc), • ■ ■ , jn{k))} k x i= 1 - Therefore, there exists a sub- 
sequence, which with a slight abuse of notation we denote in the same way, such that 
(ji(fc), . . . ,j n (k)) — (ji, ■ ■ ■ ,j n ) for all k £ Z>o- Note that, for each i £ {l,...,n} 
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such that u>(vi) > 0, the element ji is unique since otherwise the sequence {Ck\^? =1 
would not be convergent. Combining these facts with (14.21) and taking the limit as 
k — >■ oo, we conclude that G € /imcor(-D), and hence fi mcor is closed at D, as claimed. 
□ 

Next, we characterize the fixed points of /i mc0 r- 

Lemma 4.2 (Fixed points of /i mcor ). /imcor has at least one fixed point. Further- 
more, A* G Adj(G) is a fixed point if and only if A* is weight-balanced. 

Proof. Given that the digraph is strongly connected, Theorem l2 . 31 guarantees that 
it is weight-balanceable, and therefore at least one fixed point exists (if A £ Adj(G) 
is weight-balanced, then /i mc0 r(^) = {^}; an d hence A is a fixed point of /i mc0 r)- 
On the other hand, suppose A* e Adj(G) satisfies A* S /imcor (A*). We reason by 
contradiction. If A* is not weight-balanced, then (|2.1[) would imply that there exists 
at least a vertex v S V with uj(v) > 0. From (|4.ip . this would imply A* /i mc0 r(^4*), 
which is a contradiction. □ 

The logic used by the imbalance-correcting algorithm to update edge weights 
consists of using edges with the minimum weight. The next result shows that such 
logic is powerful in terms of propagating a token (in our case, an imbalance) across 
the network. 

Lemma 4.3 (Propagation of tokens via out-edges with minimum weight). Let G 
be a strongly connected weighted digraph and consider a finite number of tokens ini- 
tially located at some nodes. If each node that possesses a token repeatedly passes it to 
one of her out-neighbors via an out-edge with the minimum weight and adds a positive 
constant to this weight, all the nodes will be visited by at least one token after a finite 
number of iterations. 

Proof. Let V denote the vertex set of G. Let to denote an arbitrary initial time 
and Vis(i, to) be the set of nodes visited by any of the tokens up to time t. Since V is 
finite and Vis(i,io) C Vis(t + l,to), for t 6 Z>o, we deduce that there exists T such 
that Vis(t,i ) = Y(t ) C V, for all t > T. Let us show that Y(t Q ) = V for all t . 
We do this by discarding any other possibility. Clearly, |F(io)| cannot be 1 because 
if a node has a token, she will pass it to some other node. Let m < \V\ and assume 
that we have shown that |Y(to)| =/= 1, . . . , m — 1 for all to. Choose any to and let us 
show that |Y"(to)| rn. Suppose otherwise, i.e., l"(io)| = fn. Since the digraph is 
strongly connected, there exists at least one edge from a member of Y(to), say Vk, 
to a member of V \ Y(to), say Ufc+i. Since Vk e Y(t ), Vk has one of the tokens at 
some point in time, say t\. Suppose sends this token via an out-edge to a member 
of Y(to) and increases the weight on this edge; otherwise, |^(io)| > m + 1, which is 
a contradiction. By hypothesis, the tokens never reach V \ Y(to) and get passed in 
Y(to) while increasing the weight of edges among nodes in Y(t ). We claim that, after 
a finite time, at least one of the tokens comes back to vt- Suppose otherwise, i.e., for 
t > t\, no token will ever visit v^. Since Y(ti + 1) C Y(to) and ^ Y{t\ + 1), we 
conclude that \Y(ti + 1)| < m — 1, which is a contradiction. Therefore, a token must 
visit Vk after t\. When this occurs, node Vk will choose the out-edge with minimum 
weight for sending the token. The whole process gets repeated and thus, after a 
finite time, the weight on the out-edge to v^+i has the minimum weight, and thus Vk 
sends a token to Ufe+i, implying |Y(£o)| >m + l, which is a contradiction. Therefore, 
|Y(£o)| = | V" | , as claimed. □ 

The last ingredient we need in order to characterize the convergence of the 
imbalance-correcting algorithm is the Lyapunov function V w h ■ Adj(G) — > M>o 
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defined by 

n n n n 

Vwb(A) = £]|5^a <i -£;o ii |=5^|a;(t;i)|. (4.3) 

i—l j—1 j— 1 z—l 

This function is continuous on Adj(G). Note that V(A) = if and only if A is 
weight-balanced. We are now ready to state our convergence result. 

Theorem 4.4 (Convergence of the imbalance-correcting algorithm). For 
a strongly connected digraph G, any evolution under the imbalance-correcting 
algorithm converges in finite time to a weight-balanced adjacency matrix. 

Proof. Recall that the evolutions under the imbalance-correcting algorithm 
correspond to trajectories of the discrete-time dynamical system defined by /i mcor ). 
For an initial condition A G Adj(G), consider the sublevel set V~^{< Kvb(^4)) = 
{B G Adj(G) | < Vwb(-B) < V w b(A)}. Since V w b is continuous, this set is closed. 
Let us show that the continuous function V w h is non- increasing along /i mc0 r, and 
consequently T^ b 1 (< V w b(A)) is strongly positively invariant with respect to /imcor- 
Note that the weight of any given edge is only modified by the agent who has it as 
an out-edge. Consider a weight change done by the algorithm on an arbitrary edge 
(Uj, Vj), Vi,Vj G V, and let us see the effect it has on the imbalances of the two vertices 
it affects. According to /imcor, Vi increases the weight on her out-edge to Vj by e G K>o 
in order to balance herself. Consequently, the imbalance of agent Vj increases by at 
most e. Considered together, the weight change performed in the edge decrease the 
imbalance of Vi by e while increasing the imbalance of Vj by at most e; thus the value 
of that V w b does not increase. Since the edge (vi,Vj) is arbitrary, from (I4.3[) . this 
argument implies that V w h is non-increasing along fi mcoT - 

Next, let us show that all evolutions of (Adj(G), /i mcor ) with initial condition in 
^b X (< V w b(A)) are bounded. Suppose otherwise, and take an initial condition that 
gives rise to an unbounded trajectory. This implies that there exists, infinitely often, 
an agent v G V with some positive imbalance. Let us justify that the infimum 9 of all 
these positive imbalances is positive too. Since, by definition of /imcor, an y imbalance 
in the timesteps after the initial one is a linear combination of the initial imbalances 
with coefficients or 1, the following inequality holds 

9>v = min min {|w (v 4l ) + u (v ia ) + . . . + w («i fc )| 0}, 

fee{l,...,n} (i 1 ,...,i k )eC(n,k) 

where G(n, k) denotes the set of combinations of k elements out of n, and u>o(v) refers 
to the initial imbalance of v G V. Note that v > 0. Since J2 v ev UJ ( V ) = ®> there exists 
a set of agents Y = {v\, . . . ,Vk} C V, k G Z>o, with negative imbalance, such that 
Su-eK ^i^i) i s a ^ mos t — infinitely often. We show that this actually must happen 
always. Suppose that at some point in the execution of the algorithm ^2 v . eY tL '( v i) > 
— 9. After that, it will never happen that ^2 v . eY u { v i) = ~ otherwise, at least one of 
the agents has decreased her imbalance from a negative value, which is not possible by 
the definition of /i mC or. But this contradicts ^2 v GY u ( v i) being at most —6 infinitely 
often. The above argument shows that there exists a positive imbalance of at least 
9 that does not visit, even once, any edge going into the set Y. Finally, since G is 
strongly connected, this contradicts Lemma \A. 31 

Finally, recall that by Lemma I4TT1 the map /i mc0 r is closed on V~ h l {< V w b(A)). 
With all the above hypotheses satisfied, the application of the LaSalle Invariance Prin- 
ciple for set- valued dynamical systems, cf. Theorem 12.61 implies that the algorithm 
evolution approaches a set of the form V~ b (c) n S, where c G K and S is the largest 
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Fig. 4.1. Execution of the imbalance-correcting algorithm for the digraph of Fiaure \3.S^ a). 
The initial condition is the adjacency matrix where all edges are assigned weight 1. In each round, 
the edges which are used for sending messages are shown dashed. One can observe that the Lyapunov 
function V v ^(Aq) takes the following values in subsequent time steps: 6, 4, 4, 4, 4, 4, 0. 



weakly positively invariant set contained in {B G V~^(< V^^A)) I there exists C G 
/imcor(-B) such that Kvb(C) = Vwb(B)}. In order to complete the proof, we need to 
show that c = 0. We reason by contradiction. Suppose c > and let A 6 S PI V~^(c). 
Since S is weakly positively invariant, there exists an evolution starting from A which 
is contained in S, and hence stays in the level set V~^(c). Let us show that after 
a finite time, this evolution will leave V~^(c), hence reaching a contradiction. Since 
c G M>o, there exists at least one agent Vi with positive imbalance ui(vi) > 0. There- 
fore, since X)^e\/ a; ( 1 ') = 0> there exists a set of agents whose imbalances are negative 
and sum at least —uj{vi). Since the digraph is strongly connected, by Lemma 14.31 
after a finite time the positive imbalance uj{vi) will visit this set, which would strictly 
decrease the value of V w ^, reaching a contradiction. Finally, the finite-time conver- 
gence to the set of weight-balanced adjacency matrices follows from noting that the 
value of V w b is initially finite and, by Lemma 14.31 there exists a finite number of it- 
erations after which V^b is guaranteed to have decreased at least an amount 2v. The 
convergence to a weight-balanced adjacency matrix is a consequence of the finite-time 
convergence to the set. □ 

Remark 4.5. (Time complexity of the imbalance-correcting algorithm): 
Roughly speaking, the time complexity of an algorithm corresponds to the num- 
ber of rounds required in order to achieve its objective. More formal definitions 
can be found in [q, 2^, 3(3, |3tJ • The characterization of the time complexity of the 



imbalance-correcting algorithm is an open problem, however, we characterize in 
Section 14.21 the time complexity of a modified version of this algorithm. • 
Example 4.6. (Execution of the imbalance-correcting algorithm): Consider 
the digraph of Figure [3~2T a). The imbalance-correcting algorithm converges to a 
weight-balanced digraph in 6 rounds, as illustrated in Figure |4~T1 • 
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4.2. The mirror imbalance-correcting algorithm. In this section, we mod- 
ify the imbalance-correcting algorithm to synthesize a strategy, distributed over 
the mirror of the digraph, which converges quickly to a weight-balanced digraph. This 
procedure can be employed to construct a weight-balanced digraph without computing 
any cycle. We start by an informal description of the mirror imbalance-correcting 
algorithm. Let 67 be a strongly connected digraph of order n £ Z>o: 

(i) at each round, agents are able to receive messages from their in-neighbors. 
There is an initial round when each agent assigns a weight to each out-edge 
and sends it to her corresponding out-neighbor. In this way, everybody can 
compute her in-degree. After this, at most, only one out-edge per agent is 
changed in each round; 

(ii) each agent with positive imbalance adds it to the weight on one of out-edges 
to one of the out-neighbors with minimum imbalance and sends a message to 
the corresponding out-neighbor informing her of the change. 

(iii) multiple-messages rule: if an agent receives more than one message from her 
in-neighbors, she adds the received messages to her imbalance; 

(iv) fair- decision rule: if the agent has more than one out-neighbor with the 
exact same minimum imbalance, it randomly chooses one. However, the next 
time it needs to choose between her out-neighbors with the same minimum 
imbalance, she will choose a new out-neighbor. 

In the following, we give a formal definition of this algorithm. For all i € 
{1, ...,n}, let 

OminOO = {vj e 7V out (v 4 ) | w(vj) = mm 

ui eAf out (i),) 

We define ffimcor : Adj(G) =t Adj(G) by 

5imcor(^4) = j-B 6 Adj(G) I for each i e {1, . . . ,n}, there exists j* with Vj* S f2min( u i) 

}. (4.4) 



such that bij = 



dij + Lo(vi), if u(vi) > and j = j* 
an, otherwise 



Note that the evolutions of the mirror imbalance-correcting algorithm are a 

subset of all the evolutions of the set- valued map <7i mC or (because of the fair-decision 
rule) . The next result shows that this algorithm converges in finite time to a weight- 
balanced digraph. 

Theorem 4.7 (Convergence of the mirror imbalance-correcting algorithm). 

For a strongly connected digraph G, any evolution under the mirror imbalance-correcting 
algorithm converges in finite time to a weight-balanced adjacency matrix. 

Proof. For an initial condition A S Adj(G), consider the sublevel set V^, 1 (< 
V w i>(A)). Similarly to the proof of Theorem l4.4[ observe that the continuous function 
Vwb is non- increasing along <7i mc0 r and thus V~^(< V w b(A)) is strongly positively 
invariant with respect to gimcor- An argument similar to the one in Lemma 14.11 
shows that the map <7i mco r is closed at V^ b 1 (< V w b(A)). Now, pick an evolution 
of (Adj(G), <?i mcor ) with initial condition in VJJ b 1 (< V w b(A)) that satisfies the fair- 
decision rule. Then a similar version of Lemma 14.31 can be used to establish that this 
evolution is bounded. Thus by the LaSalle Invariance Principle for set- valued dynam- 
ical systems, Theorem I2.6[ this evolution approaches a set of the form V tt ~ b 1 (c) n S, 
where c s M>o and S is the largest weakly positively invariant set contained in 
{B e V^ b 1 (<~K,b(^)) | there exists G e g imcoi (B) such that V wh (C) = V wh (B)}. 
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Fig. 4.2. A strongly connected digraph. 

The fact that c must be zero follows from the observation that, under the mirror 
imbalance-correcting algorithm, the value of V w h decreases by a finite amount, 
bounded away by a positive constant, after a finite number of iterations. The conver- 
gence in finite time can also be justified in a similar way to Theorem 14.41 □ 

Example 4.8 (Execution of the mirror imbalance-correcting algorithm). 
Figure 14.21 shows a strongly connected digraph. Figure 14.31 shows an execution of the 
mirror imbalance-correcting algorithm for this digraph that converges in three 
rounds to a weight-balanced digraph. Note that agent t>4 has two out-neighbors with 



-1-^ — -1^ — -1^— +1 




Fig. 4.3. An execution of mirror imbalance-correcting algorithm for the digraph of Fig- 
ure ^. 2\ The dashed lines show the edges which have been used to send messages. 

the same imbalance, namely v\ and 1)5. If V4 decides to update the weight on the 
edge («4, W5) to correct its imbalance, then the fair-decision rule will make her choose 
the edge (1)4, Vi) the next time. Figure l4~4l shows the result of the execution of the 
mirror imbalance-correcting algorithm in such a case. If after the 4th round of 
the execution the agent would keep updating the weight on the edge to agent V5, 
then the algorithm would never converge to a weight-balanced digraph. • 



20 



Bahman Gharesifard and Jorge Cortes 



V% ■< — - Vi 




v 3 >. v 4 

A 3 ' 



Fig. 4.4. Another possible execution of mirror imbalance-correcting algorithm for Exam- 
ple \4-tt\ The dashed lines show the edges which have been used to send messages. 

Next, we investigate the rate of convergence of the mirror imbalance-correcting 
algorithm. 

Proposition 4.9. (Time complexity of the mirror imbalance-correcting 
algorithm): The time complexity of the mirror imbalance-correcting algorithm 

is in 0(n ). 

Proof. Let G = (V, E) be a strongly connected digraph and consider the agent 
Vi G V which initially has the maximum positive imbalance U)(vi) — r £ K>o- In the 
worst-case scenario, this imbalance should reach r agents with negative imbalance of 
— 1 and it has to go through the longest path in order to reach the first agent with 
negative imbalance —1 and, after that, through the longest path to get to the second 
agent with negative imbalance and so on. According to the execution of the mirror 
imbalance-correcting algorithm, agent Vi £ V updates the weight on the edge 
to an out-neighbor Wj+i £ V. Then, agent Vi + \ might pass the imbalance to the 
next agent in the longest path directly, or after sending it to a cycle which does not 
include any agent with negative imbalance. Then, after some finite time, the agent 
Vi + i will receive the positive imbalance r again and by the fair-decision rule, this 
time she will pick a different out-neighbor. Now, suppose that all the agents in this 
longest path have the maximum number of out-neighbors and furthermore, suppose 
that all the agents try all their other out-neighbors (via cycles) before finding the 
correct out-neighbor. Since the longest path, the maximum length of a cycle, and the 
maximum out-degree are all in O(n), the time complexity of the positive imbalance r 
reaching the first agent with negative imbalance —1 is in 0(n 3 ). Since the imbalance 
r is in 0(n), the time complexity of mirror imbalance-correcting algorithm is 
in 0{n A ). □ 

The result stated in Proposition ^. 91 is to be contrasted with the time complexity 
of the centralized algorithm proposed in fl7j ] to construct a weight-balanced digraph, 
which can be shown to be in 0(2 n ). 

5. Strategies for making a digraph doubly stochastic. In this section, 
we investigate the design of cooperative strategies running on strongly connected 
communication networks that allow agents to determine a set of edge weights that 
make the digraph doubly stochastic. 

5.1. The imbalance-correcting algorithm with self-loop addition. From 
Corollary 13.31 we know that all strongly connected digraphs can be made doubly 
stochastic by allowing the addition of self-loops to the digraph. Therefore, com- 
bining this observation with the imbalance-correcting algorithm, one can find a 
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distributed strategy that allows the agents to make any strongly connected commu- 
nication network doubly stochastic, as we state next. 

THEOREM 5.1. (imbalance-correcting algorithm with self-loop addition): 
Let G be a strongly connected digraph. If the agents 

(i) execute the imbalance-correcting algorithm, 

(ii) compute the maximum out-degree, 

(Hi) if necessary, add a self-loop with appropriate weight to make their out-degrees 
equal to the maximum out-degree, and finally, 

(iv) divide the weights on each out-edge by the max out-degree, 
then the resulting weighted digraph is doubly stochastic. 

Note that there a number of distributed ways to perform (ii), see e.g., 23|, 30| . 

Example 5.2. (Execution of the imbalance-correcting algorithm with self-loop 
addition): Consider the digraph of Figurc l3.2f a). As we showed, there exists no dou- 
bly stochastic adjacency matrix associated to this digraph. However, if we allow the 
agents to modify the digraph by adding self-loops, a doubly stochastic adjacency ma- 
trix can be associated to this digraph. Using the imbalance-correcting algorithm, 
the agents can compute the weight-balanced adjacency matrix 



.4 



/ 6 \ 

3 3 

5 

10 10 1 

V 1 J 



Now, if the agents execute the modification of the digraph by adding self-loops with 
appropriate weight, they compute the adjacency matrix 



A = 



( 6 \ 

3 3 

5 10 

10 13 1 

\ 1 5 j 



Finally, by executing a division on the weight of the out-edges, the agents compute 
the doubly stochastic adjacency matrix 



/ 




A = 




1/2 1/2 



5/6 1/6 



\ 






1/6 1/6 1/2 1/6 
\ 1/6 5/6 / 



5.2. The load-pushing algorithm. Given a digraph G = (V, E) and C £ Z>o, 

in this section we introduce a strategy, distributed over the mirror digraph, that, upon 
completion, allows the group of nodes to declare whether the graph G is C-regular. 
If it is, the strategy finds a set of weights that makes the graph C-regular. Note that, 
once such weights have been found, agents can easily determine a doubly stochastic 
weight assignment by dividing all entries by C . 

Our strategy is essentially an adaptation of the Goldberg- Tarjan's algorithm [l4| 
for the problem under consideration. This point will be clearer when we address the 
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proof of its correctness in Theorem 15.31 Let us start with a formal description of the 
strategy. 

(Initialization) 

(i) each agent can send/receive messages to/from her in- and out- neighbors. 
There is an initial round when each agent u, £ V assigns a unit weight, 
denoted ay, to each out-edge (vi, Vj), and sends this information to her cor- 
responding out- neighbor Vj. In this way, every agent can initially compute 
her in-degree; 

(ii) each agent Uj E V's memory contains a load vector (L s (vt), L t (vi)), whose 
entries are termed source- and target-load, respectively, and a height vector 
(H s (i)i), H t (vi)), whose entries are termed source- and target-height, respec- 
tively. These variables are initialized as, 

L s (vi) = C - d out (vi), L t (vi) = d iD (vi) - C, 
H s (vi) = 2, H t (vi) = 1; 

(iii) each agent Vi E V sends the initial source-height H s (vi) to her out-neighbors 
and the initial target-height H t {vi) to her in-neighbors. When agents receive 
this information from their in- and out-neighbors, they compute 

ifr X " in K)= max H s {v 3 ); 

Vj GAA m (ui) 

(Algorithm steps) 

(iv) at each time step, if L s (vi) > and 

(push forward): there exists an out-neighbor Vj E Af° ut (vi), where cijj < C 
and H s (vi) > H t (vj), then agent Vi sends the load L s (vi) to Vj and resets 

dij := dij + L s (vi) and L s (vi) := 0; 

(declare digraph not C -regular): there exists no out- neighbor Vj GAf° ut (vi) 
such that a,ij < C and H s (vi) > H t (vj), agent Vi announces that the 
digraph is not C-regular and the algorithm terminates. 

(v) at each time step, if L t (vi) > and 

(push backward): there exists an in- neighbor Vk E Af out (vi), where ati > 
Lt(vi) + 1 and Ht(vi) > H s (vk), then agent Vi sends the load Lt(vi) to 
Vk and resets 

aki := «fci — L t (vi) and L t (vi) := 0; 

(increase target-height): there exists no in- neighbor Vk E Af out (vi) such 
that aki > Lt(vi) + 1 and H t (vi) > H s (vk), agent Vi resets 

H t ( Vi ) :=H™*- in (v t ) + l, 

and sends a message to her in-neighbors informing them of her new 
target-height. 

We refer to the algorithm described above as the load-pushing algorithm. Note 
that this strategy is distributed over the mirror digraph of G. The next result char- 
acterizes its convergence properties. 

Theorem 5.3. (The load-pushing algorithm finds a C-regular weight as- 
signment iff the digraph is doubly stochasticable): Let G = (V, E) be a digraph 
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and C > max{max„ 6 y d out (v), max^y d in (v)}. If the load-pushing algorithm an- 
nounces that G is not C-regular and C > \E\ — \V\ + 1, then the digraph is not doubly 
stochasticable. If G is doubly stochasticable and C > ds(G), then the load-pushing 
algorithm converges to a C-regular digraph. In both cases, the algorithm terminates 
m 0{\V\ 2 x l^l) steps. 

Proof. We start by showing that the problem of finding a C-regular digraph 
can be reduced to a maximum flow problemjwithjaositive lower bounds on the edge 
loads Consider the bipartite digraph G = (V,E), where 

• V contains two copies of V, named V u and V w , & source node s, and a target 
node t, i.e., 

V = {s} UVuUVwU {t}. 

In other words, the nodes ui £ V u and Wi G V w correspond to the agent 
v, e V; 

• E is defined as follows: there is no edge between vertices in V u and there is no 
edge between vertices in V w . For each edge (vt, Vj) in E 7 there exists an edge 
(ui, Wj) G E; there is an out edge between s to all Ui in V u and an out-edge 
from each Wi in 14, to i 

Next, let us define a maximum flow problem on G. Let the capacity on each edge of 
the form (s 7 Ui) or (wj,t) S E, i,j S {1, . . . , \V\} be exactly C. Let the capacity on 
each edge (m, Wj) € E be lower bounded by 1 and upper bounded by C. We refer to 
the weight of such edg GS cLS Q>ij i and therefore, 1 < ay < C. Consider the following 
problem: find the maximum flow that can be sent from the source s to the target t. 
It is not difficult to see that, by definition of C-regularity, the digraph G is C-regular 
if and only if the maximum flow of the problem just introduced is C|V|. 

Following [J 0] , the maximum flow problem with lower bounds described above 
can be transformed into a regular maximum flow problem as follows. Define a~ij ~ 
~dij — 1. The bounds 1 < < C now become < ay < C. Let the capacity on each 
edge of the form (s, m) £ E be 

C- J2 l = C-d out ( Vi ). 

Let the capacity on each edge of the form (wi, t) G E be 

-C+ J2 l = -C + d ia (v i ). 

The proof now follows from noting that the execution of the load-pushing algorithm, 
when transcribed to this maximum flow problem, exactly corresponds to the execution 
of the distributed version presented in [31] of the preflow-push algorithm of Goldberg- 
Tarjan algorithm [14]. Note that, given our discussion in Section 02 it is enough to 
execute load-pushing algorithm for C > \E\ — \V\ + 1 (cf. Lemma T3.14p to deter- 
mine if the digraph G is indeed doubly stochasticable. The time complexity of the 
algorithm is a consequence of 0, Theorem 3.11]. □ 

It is worth mentioning that without the characterization of doubly stochasticable 
digraphs, a negative answer from load-pushing algorithm for a given C would be 
inconclusive to determine if the digraph is indeed doubly stochasticable. At the same 
time, the results of Section [3] imply that, if a digraph is doubly stochasticable and 
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the load-pushing algorithm is executed with C > ds(G) (which in particular is 
guaranteed if C > \E\ — \V\ + 1), then the strategy will find a set of appropriate 
weights. 




Fig. 5.1. A doubly stochasticable digraph with ds(G) = 2. 

Example 5.4. (Execution of the load-pushing algorithm): Consider the di- 
graph shown in Figure 1531 One can easily check that this digraph is doubly stochasti- 
cable and ds(G) = 2. Suppose the agents want to find a C-regular weight assignment 
and they run the load-pushing algorithm for C = 3 > ds(G) = 2. Figure I5T21 shows 
the execution of the algorithm. To represent its evolution, we associate to each vertex 
Vi, i € {1, . . . ,4}, the source- and target-loads and a subindex with the source- and 
target-height. The algorithm converges to a 3-regular digraph in 5 iterations. • 

6. Conclusions. In this paper, we have fully characterized the properties of 
two important classes of digraphs: weight-balanced and doubly stochastic digraphs. 
Our results greatly enlarge the domain of systems for which a variety of distributed 
formation and optimization algorithms can be executed. The first contribution is a 
necessary and sufficient condition for doubly stochasticability of a digraph. We have 
unveiled the particular connection of the class of doubly stochasticable digraphs with 
a special subset of weight-balanced digraphs. The second contribution is the design of 
two discrete-time dynamical systems for constructing a weight-balanced digraph from 
a strongly connected digraph: (i) the imbalance-correcting algorithm, running 
synchronously on a group of agents, and (ii) the mirror imbalance-correcting 
algorithm, distributed over the mirror of the original digraph. We have established 
the finite-time convergence of both strategies via the set- valued discrete-time LaSalle 
Invariance Principle. We have also characterized the time complexity of the mirror 
imbalance-correcting algorithm, which is substantially better than that of the 
existing centralized algorithm. The third contribution is the design of two discrete- 
time dynamical systems for constructing a doubly stochastic adjacency matrix for 
a doubly stochasticable strongly connected digraph: (i) the imbalance-correcting 
algorithm with self-loop addition, works under the assumption that agents are 
allowed to add weighted self-loops. We showed that any strongly connected digraph 
can be assigned a doubly stochastic adjacency matrix with this procedure; (ii) the 
load-pushing algorithm, distributed over the mirror digraph, for the case when 
agents are not allowed to add self-loops. The convergence of this algorithm, and its 
time complexity, has been established by formulating the problem as a constrained 
maximum flow problem. 

Regarding future work, we would like to better understand the gap between ds(G) 
and p(G) for doubly stochasticable digraphs. We would also like to study the case 
when zero edge weights are allowed and, in particular, develop algorithmic proce- 



Distributed strategies for generating weight-balanced and doubly stochastic digraphs 25 






Fig. 5.2. The execution of the load-pushing algorithm for the digraph in Fiaure Y5.1\ At each 
iteration of the algorithm, the pair (L s , Lt)^H s .H t ) * s shown for each vertex. At each iteration, 
dashed lines represent the edges used by the vertices to send loads. Observe that (2), (3), (4), (5), 
respectively, correspond to the operations push forward, increasing target height, push backward, and 
push forward. 



dures that can identify a strongly connected spanning subdigraph which is doubly 
stochasticable. To our knowledge, the synthesis of a distributed dynamical system 
that computes doubly stochastic weight assignments when agents communicate only 
over the original digraph, and not over the mirror digraph, is still an open problem. 
Finally, we would like to employ the results of this paper to extend the range of ap- 
plicability of existing distributed algorithms for coordination, formation control, and 
optimization tasks. 
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